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Copy control using digital speed bumps 



TECHNICAL FIELD 

The present invention relates in general to the field of copy protection of 
digitally recorded media, and in particular to a method for controlling a digital media 
recorder and such a recorder. 

5 

BACKGROUND 

More or less unauthorized copying of media content that is copyright protected 
has been an important issue for a long period of time. For example, audio records have been 
copied onto cassette tapes and television programs and fihns have been copied onto video 

10 tape. Unauthorized copies of such types of analog recording media have all been marred by at 
least a slight decrease of quality as compared to the original recordings. 

However, the issue has become even more important as the media industry has 
entered "the digital era". Music and films are now being distributed in digitally encoded form 
and copies of tibiese are usually indistinguishable firom the original, creating an even bigger 

1 5 market for "pirates" of media content. 

To illustrate the situation one can consider the recordable compact disc, i.e. the 
CD-R. These are usually intended for recording audio content. However, any media content 
may be recorded on such discs. Moreover, while the following discussion wiU be exemplified 
by CD-R, there exist other digital recording media capable of recording media m the form of, 

20 e.g., films that are equally relevant for the discussion. 

Ever since its market introduction, CD-R has been an overwhelming success 
story. One of the main factors contributing to its rapid acceptance is that consumers now have 
the possibility to make digital quality copies of the most popular audio format - the Compact 
Disc - that will play in any CD player. Whereas CE style CD recorders, i.e. dedicated digital 

25 audio copying devices, have to implement the Serial Copy Management System (SCMS), 
which limits duplication of copyright asserted discs to first generation copies, there are no 
built-in limitations for PC based CD recorders. The latter has become a huge problem fi-om 
the perspective of the content owners, which are facing the horror scenario that immediately 
after release of, e.g., a new music album, large numbers of CD-R copies are traded or offered 
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for sale on school yards and similar environments. Consequently, and especially in 
combination with the mp3 phenomenon on the Internet, content owners consider CD-R a 
major factor in the stagnating growth of CD sales. 

Technical measures that prevent misuse of recorders, such as making large 
numbers of copies are therefore highly desirable. At the same time the convenience of the 
devices should not be compromised, e.g. if copying is allowed by the owner of the content, 
then one should be able to do so at high speed. 

A prior art solution within the technical field of copy protection of digital data 
is presented in the International Patent Application published with the number WO 00/04688. 
There, a method and a system for protecting digitally watermarked media content includes 
generating digital tickets associated with the media content. The ticket holds information 
regarding a receiver and the copy protection status of the content as well as the digital 
watermark. The content of the ticket is processed by the receiver in order to determine 
whether or not the receiver is allowed to copy the content. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide a solution to a problem of how 
to provide a more flexible handling of copy protection of digital media content. 

According to a first aspect, the invention as claimed in claim 1 below provides 
a solution by way of a method of controlling a digital media recorder capable of recording 
digital media sequences on a digital media carrier. A sub-sequence is extracted from an input 
media sequence, such as an audio or a video sequence. A digital fingerprint of the sub- 
sequ^ce is calculated and compared with at least one first reference fingerprint, which is 
fetched from a primary database of fingerprints. The outcome of flie comparison yields a first 
comparison value to be used in determining the action to take in the fiirther processing. 
Depending on the first comparison value, recording of the input media sequence on the media 
carrier is either allowed or obstructed, e.g. disallowed. In the case recording of the sequence 
is allowed, the primary database is then updated with information that the digital media 
sequence has been recorded on the media carrier. 

Preferably, the primary database of fingerprints includes a copy count number 
and a copy limit number associated with fingerprints in the list. Then, the step of comparing 
the sub-sequence fingerprint with the first reference fingerprint includes comparing the copy 
count number and the copy limit number and the step of updating the primary database 
includes updating the copy count number associated with tiie fingerprint. 
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In order to properly handle multiple occurrences of a sub-sequence within a 
media sequence, the invention preferably further involves comparing the sub-sequence 
fingerprint with at least one second reference fingerprint, said second reference fingerprint 
being fetched fi-om a secondary temporary database of fingerprints. This comparison yields a 
5 second comparison value, which is used to determine the fiirther processing. Depending on 
whether or not the second comparison value indicates that the fingerprint exists in the 
secondary database, the fingerprint is stored in the secondary database. The prinoiary database 
is finally, when recording is completed, updated with information firom the secondary 
database. 

10 The recorder checks if any recording that is being made, has been made 

previously by looking up the fingerprint in the primary database. If that is the case, some 
appropriate action is taken, such as aborting tiie recording, or adding noise etc. Since the 
database has a finite size, older entries are removed in favour of newer ones, preferably on a 
first in-first out basis, which means that after a while recordings that were blocked will be 

15 permitted again. This results in that, within a preset amount of time, as determined by the size 
of the database, duplicate recordings are prohibited, but independent of the speed a which 
recordings are made. 

It is to be noted that the addition of a copy coxmt and copy limit with each data 
base entry allows dupUcates to be made in series of more than one recording. For example if 

20 the copy limit is set to 3, a series of three duplicates can be made. Subsequently the user has 
to make a large number of other copies, and next a new series of three copies can be made 
etc. 

For any new recording it is verified that the database does not contain its 

fingerprint, or if it does, that the maximum number of copies has not yet been made. 
25 Otherwise, the recording shall be prohibited, continued with reduced quality, or some other 

appropriate action shall be taken. That is, the recorder remembers what recordings have been 

made, by storing fingerprints in the primary database. 

In other words, the technical effect of the present invention can be defined by 

the concept of a "speed bump," which does not prevent copies of being made, but rather 
30 limits the rate at which those copies can be made. In its basic form the concept is 

straightforward: let recorders prohibit more than a given number of copies to be made within 

a given time firame. 

In order for the proposed speed bump mechanism to be effective, especially in 
the PC world, it should not be thwarted easily by making imperceptible changes to the digital 
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content of the media. This rules out implementations that rely solely on cryptographic hash 
functions. However, a viable alternative to use is the robust audio hashing, or fingerprinting-, 
technique disclosed in the following paper: Jaap Haitsma, Ton Kalker and Job Oostveen, 
"Robust Audio Hashing for Content Identification,"Content-Based Multimedia Indexmg 
conference 2001, Brescia, Italy. This technique allows extraction of robust features firom the 
recorded media content, which a recorder can keep in an intemal database. 

An advantage of the proposed mechanism is that no special preparation of the 
original media content is required as is the case with prior art systems that rely on signaling 
by embedded watermarks. This is also trae for the recordings (e.g. remarking is not 
necessary). Therefore audibility issues do not play a role. Furthermore, intentional signal 
distortion threats, e.g. in order to remove watermarks, are non-existent either. 

Another advantage of the invention is that usage for personal purposes is 
effected only to a small degree - depending on the permissible copy rate - while usage for 
(semi-) business purposes is substantially fiiistrated. 

Yet another advantage is that also in PC based recorders the speed bump 
mechanism can operate autonomously, i.e. without help firom the main processor of the PC, 
when realized in a separate hardware module in the recorder itself as will be discussed in 
some detail below. 

A fiirliier advantage of the speed bump mechanism according to the invention 
is that the fingerprinting technology itself does not need to be standardized-it may even yield 
a competitive advantage to keep it proprietary just the concept itself and the effectiveness of 
the speed bump, i.e. the maximirai number of copies per series and the amount of time that 
should pass until anothCT series of copies is permitted. 

According to a second aspect, the invention as claimed in claim 7 below 
provides a solution by way of a digital media recorder capable of recording digital media 
sequences on a digital media carrier, the technical effect and advantages of which correspond 
to the first aspect of the invention as discussed above. 

BRIEF DESCRIPTION OF THE DRAWINGS 

A digital media recorder and a method of controlling such a recorder will now 
be presented with reference to figures 1, 2 and 3, where: 

Figures 1 and 2 show schematically a digital media recorder according to the 

present invention, and 

Figure 3 shows a flow chart of a method according to the present invention. 



wo 2004/008457 



5 



PCT/IB2003/002935 



PREFERRED EMBODIMENTS 

Although the embodiments will discuss only audio sequences and use 

teraiinology relating to audio recordings, other types of media are considered to be 

equivalents and will not be discussed separately. Moreover, it is to be understood that the 

invention is applicable to other kinds of digital recording media than the exempUfied CD-R, 

such as media that are based on magnetic recording techniques. 

Figures 1 and 2 show, respectively, a digital recorder 100,200 comprising an 

input/ou^ut unit 102,202 connecting to a digital media source 101,201, memory 103,203, a 

processing unit 104,204 and a recording unit 105,205 capable of receiving removable blank 

recording media 108,208 such as CD-R. 

As figure 2 illustrates, a separate control unit 209 may be present in addition to 

the processing unit 204. As the skilled person realizes, all units are connected via a bus 
106,206 and, as illustrated in figure 2, may also include a connection 207 to a computer. 

Media content to be handled by the recorder 100,200 originates in a media source 101,201. 

As llie skilled person realizes, such a media source 101,201 maybe in the form of a data 
stream firom an extemal computer, a digital output from a digital playback device etc. 

As will be evident from the description to follow of a method according to the 
invention, the speed bump mechanism does not necessarily work on the level of albxmis or 
tracks, but rather on the basis of recording time, i.e. sub-sequences of tracks or albums. The 
flow chart in figure 3 shows a schematic overview of the algorithm. There are two databases 
that play a role: a primary database that contains fingerprints of recordings made on discs 
prior to the current one, and a secondary database that contains Ihose of the current disc. Both 
databases are realized, as the skilled person understands, in the memory 103,203 of the 
recorder. 

With reference to the flow chart in figure 3 as well as to the arrangements in 
figures 1 and 2, a method according to the invention will now be described. The method is 
preferably realized in the form of control sequences, i.e. software, stored in the memory 
103,203 of the recorder 100,200. The software is run by the processor 104,204, the copy 
control unit 209 and/or by both processor 104,204 and control unit 209 in cooperation. 

Furthermore, the method assxunes that a recording medium 108,208 in the 
form of a disc (e.g. CD-R) is inserted into a recorder according to the invention, such as a 
recorder disclosed in figure 1 and 2. Moreover, reference will be made to the primary and a 
secondary database. 
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Begimiing the inventive method, in an input and extraction step 301 
fingerprints are extracted on a continuous basis firom the audio content that is being received 
firom the media source 101,201 and that is intended for recording. 

Each of the extracted fingerprints is compared to a primary database for a 
match in a matching step 302. If no match is found, implying that a recording of the sequence 
is authorized, the method continues in a storage determination step 305. During the storage 
determination step 305 it is decided whether or not the fingerprint is to be stored in the 
secondary database. The decision is preferably based on criteria regarding time intervals, i.e. 
the duration of the sub-sequence in question. Another criteria to select the fingerprint for 
storage may be based on properties of the fingerprint itself. Any combination of criteria may 
also be used. These criteria will be discussed in some more detail below 

Continuing the inventive method, if a matching entry that has reached the copy 
limit is found in the matching step 302, a check is made in a checking step 303 whether the 
copy limit has been reached. An appropriate action will be taken in an action step 304 if the 
copy limit has been reached. The action taken in step 304 preferably has the effect of 
degrading the recording, hence decreasing the "value" of the recording, and includes such 
actions as aborting the recording process, continuing the recording process at a reduced 
quality as well as notifying a user of the action taken. 

However, if the matching entry has not yet reached the copy Ihnit, as is 
checked in a copy limit checking step 303, the fingerprint is stored m the secondary database, 
as indicated in a storage step 307. If the fingerprint is already present in the secondary 
database, there is no need for storing it again, as is indicated by the checking step 306. 

The step of recording then takes place in a recording step 308 and proceeds 
according to procedures known in the art. 

In a checking step 309, it is decided whether or not the recording is finished. If 
not, control returns to the step of input and extraction step 301. 

When all recordings have been made correctly and also when the current disc 
is ejected from the drive, as checked in checking steps 310 and 31 1, the primary database is 
updated from the secondary database in an updating step 312. This updating step 312 
involves incrementing the copy counters of the fingerprints that occur in both databases, and 
moving the remaining fingerprints from the secondary to the primary database using a first-in 
first-out strategy. 

The above algorithm correctly deals with repetitions within a piece of audio, 
which frequently occurs in, e.g., classical music. Basically the idea is that it is not important 
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how many copies exist on a single disc, because these cannot be sold or given away 
separately. Therefore, these are treated as a single instance. 

The database is, as already presented, divided into two parts, namely the 
previous history of fingerprints in the primary database, and the fingerprints of the current 
disc in the secondary database. To ensure that the speed bump mechanism according to the 
invention is not activated for failed recordings, only he primary database is used for 
verification purposes. Updating of this database does not occur until the disc has been 
ejected, and all recordings on that disc are correct 

As discussed above in connection with the storage determination step 305, 
fingerprints of sub-sequences are stored in the secondary database at more or less regular 
time intervals. The effect of this is to introduce a firequent degradation of a recording, 
decreasing the "value" of an unauthorized recording of the media sequence. 

A more detailed discussion of the criteria regarding the regularity of the 
fingerprint storage will now follow. As akeady discussed, when a copy limit has been 
reached for a particular media sequence the fingerprint is to be stored in the secondary 
database. The regularity, i.e. time scale, of these storage actions is preferably dependent on 
the type of content that is being copy controlled, and partly dependent on the fingerprinting 
algorithm used. The time scale for the sub-sequence should be significantly shorter tiian a 
complete media sequence that is under consideration. For example, for modem popular music 
where songs typically last no more than a few minutes, a one minute sub-sequence may be 
appropriate. This means that if an unauthorized recording is attempted, there will be several 
instances of the action step 304 (e.g. distortions of tiie recorded signal with a preset or 
adaptive duration and intensity) in that recording, substantially decreasing the quality of that 
(unauthorized) recording. For video sequences a sub-sequence time interval of 5 or 10 
minutes may be appropriate, since a movie typically lasts well over one hour. Altematively, 
an additional random time interval may also be used. 

The regularity of the storage of sub-sequence fingerprints may also depend on 
the fingerprinting algorithm that is used. For example, the algorithm of the already referenced 
paper (Jaap Haitsma, Ton Kalker and Job Oostveen, "Robust Audio Hashing for Content 
Identification,"Content-Based Multimedia Indexing conference 2001, Brescia, Italy) 
generates a substantial amount of information in a short amoiuit of time. Consequently such a 
method is preferably used in 'Tjurst mode," i.e. fingerprint information is stored in the 
secondary database for short content firagments only. Otiier fingerprinting algorithms are 
conceivable that generate information at a much slower rate; it may even be possible to store 
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all information in the database, which would imply that the interval decreases to zero and that 
the sub-sequence in fact is the complete media sequence. 

An example of the performance of a method as described above will now be 
briefly reported. 

5 Based on the fingerprinting method disclosed in the previously referenced 

paper: Jaap Haitsma, Ton Kalker and Job Oostveen, "Robust Audio Hashing for Content 
Identification, "Content-Based Multimedia Indexing conference 2001, Brescia, Italy, the 
following estimates for the performance of the speed bump algorithm as presented above, can 
be made. Needless to say, this is only one example and is included here for illustration 

10 purposes only. Other optimizations and choices are possible, as the skilled person will 
realize. 

Fingerprint information is gCTierated at a rate of about 1 kB per 3 audio- 
seconds. For each audio-minute the fingerprint of a contiguous 3/8 audio-sec firagment is 
stored in the database, which takes about 16 bytes employing a reasonable optimization 

15 technique. Assuming that a speed bump of 16 real-time hours is reqxiired and recording 

occurs at single speed, the primary and secondary database sizes should be about 15 kB and 1 
kB, respectively. For searching the database a bit-error rate in the fingerprints of l-in-8 yields 
sufficient robustness against common signal processing "attacks" (e.g. all-band filtering, 
equalization, subsequent D/A and A/D conversions, and mp3 compression at 128 kbps). 

20 Assunodng a brute force search strategy, it takes on average 4 byte comparisons per 
fingerprint to decide that a there is no match, which translates to a required memory 
bandwidth to the database of about 320 kB/audio-sec. Finally, tiie false positive rate can be 
estimated to be about 2x10"'^ per audio-sec. Note that at higher recording speeds ttie figures 
for the primary database size, memory bandwidth, and false positive rate have to be adjusted 

25 accordingly to maintain the effectiveness of the speed bump. 

Hence, to sununarize: a digital media recorder and a method of controlling 
such is shown. Dviring attempts to copy media content such as audio or a video sequences, 
sub-sequences are extracted fi-om an input media sequence. A digital fingerprint of the sub- 
sequence is calculated and compared with at least one fiurst reference fingerprint fi"om a 

30 database. The outcome of the comparison determines the action to take in the fiuther 

processing. Recording of the input media sequence on the media carrier is either allowed or 
obstructed, e.g. disallowed. In the case recording of the sequence is allowed, the database is 
updated with information that the digital media sequCTce has been recorded. This has the 
effect of a "speed bump," which limits the rate at which those copies of media content can be 
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made, i.e, the effect is that of prohibiting more than a given nxmiber of copies within a given 
time frame. 



